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Abatrti . The problem of co mput er architecture for intelligent robots with partial autonomy is 
addressed. Robot with partial autooomy is considered a degenerated case of a fully autonomous robot. 
Thus, the problem of man-machine coniTnunira tion is formulated, and the are determined 

for generating a language for such a cnmmwni a tiiMi- The dntieurfthg mu«aer Mg — 
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1. Introduction 

Problem of partial autonomy. The problem of partial autooomy is usually considered to be a 
problem of enhancing the capabilities of a teleopeoted pobot Partial autooomy is oteant to compensate 
for the deficiencies of human per ce p ti on and/or performance (DHPP) when the CRT is used as a 
"narrow window" to the world, and no or limited other means of perception are available. After the 
partial autonomy emerges as a necessary p ropert y of an intelligent robot, one can expect to utilize it 
also for simple repetitive jobs, other routine operations, in other words, as a tool of automated 
operation rather then autonomous operation. 

The first term (automated) means independent operation of * machine, following a set of prescribed 
decisions which are submitted by a human operator in advance, In other words, automation presumes 
existence of an explicit, and/or implicit program of operation: all decisions are already made, and all 
possible situations xe taken in account The second term (autonomous) presumes that there are stages 
of planning and decision-making p erf orm ed by the machine with no human involvement In fact, 
autonomy m ea n s that the set of operations to be performed (or "jobs") is not well structured, more 
than one possibility exist, and it is up to the robot to select which one is more beneficial.(This can 
happen not only when the field of view is narrow and/or cluttered by unknown objects. For example, 
making a step upon an unstructured surface by a multilmk redundant leg, gene rates a huge set of 
ill-defined problems. Human operator cannot and need not share his attention among all these 
problems). 

The problem of joint design of man-machine control system was first addressed in [1]. Based upon the 
notion of a limited "bandpass required of a man" the paper suggests that the control system should be 
allowed autonomy in "integration, differentiation, feedforward", and a number of other computation 
procedures in order to allow a roan "to operate as a simple amplifier". The fact that a human operator 
still has to perform a unique job of information integration and decision making, at this stage was 
overlooked. However, very soon the human capabilities to be a universal feedback with unlimited 
"sensor fusion" talents were questioned in [2]. 

Rapid growth of the requirements to productivity and quality factors, brought DHPP mentioned above 
to the attention of researchers in the area of advanced control systems. The variety of tcleopcratcd 
and supervised automated systems described in [3-5] coocentnte upon enhancement of human 
capabilities by allocating some properties of autonomy within the machine control system. The 
state-of-the-art reflected in the literature, implies the sequence of development stages as shown in 
Figure 1. A need in the Interactive Manual-Automatic Control arises in a natural way due to the DHPP. 
According to [5], manual-automatic control allows for some morions under the manual control whereas 
the remaining motions are performed automatically referenced to a variety of sensor data. One of the 
systems created at JPL, features a menu which can be activated by an operator in modifications 
starting with fully manual and ending with fully automated ope ra tion. 

However, the system with partial autonomy can be approached m a different way. Let us imagine that 
the structure of a system is available with full autonomy of operation. How does this structure look 
like? What are the components of this structure that can and cannot be achieved by the technological 
means under consideration? It may hap p en that some elements of the autonomo u s operation can never 
be achieved, or can be achieved in a very remote future. The set of such "unachievable-now“ 
operations can be considered domain of impossibility of the mission (DIM-area).Tben it would 
be reasonable now to make a step back from the ideal image of the autonomous machine, and build a 
system which rely on human participation however only within the limited part: within the DIM-area. 

This approach to the problem of partial autonomy can be illustrated by Figure 2. We can see that the 
supervised automation is viewed as a retreat from die demand for a fully automated system. In the 
same vein, the partially autonomous, or supervised autonomous robot can be considered a trade-off 
between the demand for a fully automated system (which has never been satisfied), and a demand for 
a fully autonomous system (which cannot be satisfied, at least currently). 
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Focus of coaccntyation Problem of antonomous robot operation is often erroneously considered 
a problem of intelligent perception. In foot, even having the problems of perception and knowledge 
organization solved, the problem of motion planning and control of autonomous as well as partially 
autonomous robots lemmas unresolved. This paper a tt emp ts to formulate methods of theoretical 
analysis for partially autonomous pUnnmgtorrol p ro cesses of aclass of intelligent robots equipped 
by a control architecture designed for folly autonomous operation. This control architecture has an 
i mp ort ant distinction which affects supervised op erati on with partial autonomy. Areas of motion 
plMmmg. and motion control are treated separately in non-autooomous systems where such a practice 
is acceptable . Autonomous systems are intrinsically based upon a unified computer system jointly 
emulating planning-control activities as a pvt of a unified recursive computational process.Thcory of 
joint planning-control systems and processes, applicable for robots equipped with Autonomous 
Control Systems (ACS) ascends from the theory of decision making in the framework: of the control 
systems theory. 

ACS were introduced first in [6-9], and the dements of ACS theory are presented there. ACS are to be 
itKtaiiod |n autonomous robots which should operate in unknown environment with limited human 
in volv emen t or with no human involvement at alL ACS are e ye ted to function using human-tike 
procedures of per c e p tion , They have to sophisticated information structure capable of dealing 

with learned knowledge, and communicating with so called, knowledge based control systems 
(KBCSX We make a distinction b e twe e n knowledge, info r m ation, and data. Knowledge is understood 
as a structured information incorporating numerics! data as well as linguistics!, or symbolic 
information, which must be int e rpreted in a definite context It will be demonstrated that the 
principle of nested hierarchies allows for an efficient knowledge organization in KBCS as well 
as for corres po n dingly e fficient processes of knowledge-based perception and control. 

If Joint PlaaningControl Process 

Control solutions to be considered The word control is being used here in its initial meaning 
for decision making activities including planning, navigation, and guidance. This triad is presumed to 
be applicable V least, to systems for control of mechanical motion. It should provide a mapping of the 
a)task,b)knowkdge of the system, and c) knowledge of the environment - into the output 
spccificarions-This triad is an inseparable whole, and each of the elementary pans of this triad can 
operate property only in cooperation and coordination with the others. 

An overview of the recent results in the area of A uton o m ous Control Systems for mobile robots [10], 
suggests that different control solutions show definite resemblance with human teams: they have a 
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hi e rarch y of deorioo-mridnt anitt eren when the qrrtcm h equipped by a single actaatoc [11]. hi 
Hears 3, three examples of control sanctum are compared [12-16). Each rf lime structures consists 
of » namber of goal setting decision nnitt. each tenth to form «n in t ellig e nt module foe automatic 
g engat k m of rootrol st rat egies , policies, and c o cmandi 

However, the most remarkable thing abort all of theie rattans it that m an of them the scope of 

decision maloag is becoming smtlkr, and the l esohrtioo otdocision making ia becoming higher when 

Ihe level of deexnan making is becoming lower. This sequential multiple process of dedsioa nuking 
(replanting, and finding a new control sequence) in the tame situation at differen t resolutions, and 
with different scope of attention, seems to be almost obvions. The major t heore t ical and design 
m hidden in this fact, and thus usually escape from our attention. We would 

as s ume that the underlying theory should be applicable to ACS. 

The major result pronounced within the theory of team control as applicable to robotics, is related to 

the information anrlmr "-rpifrr^ tr> mu rtw Th. this i wfti M twi wnffn. ■'« . 
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Figure X Conperisoa of coand flnjctutes proposed for 
Amoaonoos Robots by the auebon of 

special, cont rol oriented knowledge structure. (This subject was addressed in [16], and familiarity 
with the treatment of the problem given there is presumed).Theory of control oriented knowledge 
organization as a part of the ACS, is focused upon development of models of KBCS for motion, 
structures of algorithms, and design of systems for optimum morion of autonomous or 
semiautooomous systems. Theory of ACS employs the fret that the similarities among the existing 
structures of control (mostly, knowledge-based) for autonomous robots reveal a number of inner 
mechanisms of goal oriented dealing with knowledge, as a part of ACS functioning. 

Roughly speaking, any ACS is organized as a team a/ krnman dtciiitn mekrrt which allow for 
using many efficient solutions developed for human teams. Using the theory of team-control an 
efficient p ro ce d ure of computation can be arra n ge d which enables real-time operation of ACS. Thus, 
emphasis is done on solutions which are tractable, and do not lead to NP-hard problems. In the 
knowledge based controllers this problem gets a specific content: information structure should be 
suited a proper knowledge qu an t izatio n. Some steps m this direction were made in [6-9]. 

Hierarchical structures of attention and resolution . In this subsection we will consider 
some of the pe c u liar p rop er ties of hierarchical control sy stems . Hk*?rch>cal decn<rnpc*itk» of systems 
is a well known phenomenon, and is used usually os a method of dealing with their complexities A 
system is bong d eco mposed in parts (parti booed) when the parts contain some ac rive elements of the 
systems subject to control (actuaton). Thes, it is typical to consider multiartuator control systems in a 
form of "tree-hierarchies". Most of the statements in the theory of intelligent control, are formulated 
for the "tre e - hierar chies" of the multi actuator systems, where the hi erar chi cal decentralized techniques 
are recommended: relative independence of the levels is as i m p ort an t, as coor dina tion of the branches 
[17-21]. The hierarchy is being preserved by the fact of resolutiooal as well as attenrional nesting. A 
typical decentralized control system allows for a tree-decomposition which leads to a nested hierarchy 
exemplified in Figure 4,a. 

A degenerated case is turned out to be of substantial importance: when no multiplicity of actuasa: 
exist, and yet, a single actuator needs a nested stem-hierarchy of decision-makers in order to be 
property controlled (e.g. shown in Figure 4,b). Usually, hierarchical systems are convenient as a form 
of organization for large systems which contain a number of goal-seeking decision units 
(subsystems). Thus, the problem usually includes coordinating their actions as to optimize the process 
of goal achievement 

Dedsioa making processes In a nested hierarchical structure. Decision-making process 
which is being done upon the nested set of repr e sen t ation s can be characterized by different frequency, 
accuracy, and combinational power. However, this difference can be stated only if the absolute values 
of these criteria are compared. Indeed, the frequency of decision-making is the lowest at the 
representation "a" (2.HT*to 10" 3 Hz), is higher in representations "V and "c" (10" 3 to 10" 1 Hz), 
and is the highest in rep r es entation "d" (1C 1 to 5Hz). 












Certainly, if the zooming it being continued, the subsequent mag nifying the image win bring 
attention lo the processes of controller compensation, and the frequency of deciiiooHiatang wfll grow 
even more. On the other hod, the accuracy of deriskto-makiiig it the lowest for the representation V: 
the enor of dedtion can be in miles, and then de c r eases down to inches in figure "c\ Certainly , on 
the level of controller compensati on, the re q uir e d accuracy might be even higher. Speaking about 
"combinatorial power", the solutions of represent a t ion "a" can lead to substantial d iffere n c es in the 
overall operation, while the variety of alternatives for the narrow scope of representati on "c“ does not 
seem to be as drastic as in the case of "a". 

However, all these matters assume a totally different consideration. The real difference between 
representations "a" through V is in the resolution of represen tation. Indeed, resolution (or the 
smallest distinguishable foment of die image) in the case "c" is smafl, and in the case “a" is large, 
practically, the values of resolution are d etermi ned by the values of the accuracy allowed). First, we 
notice that the number of "objects" of the world represented mall of the images is the same due to the 
difference of resolution. Secondly, we can easily find that at a great frequency of decision-makmg at 
a level of consideration, the moving robot (s pee d is constant) win pass during the period of time 
bet ween two consecutive decisino-making processes, the same y anrity of resolution units » that the 
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is constant at all levels. After simple tnnsformatioii we receive that 


(resolution at the level) 
for ail levels of consi de ra ti o n. 

Similar consideration brings us to conclusion that "combinatorial po w er" is also the same at all levels 
of consideration; it is just applied to different units of infor ma tion, units that have different resolution. 
This hierarchy of represen t at i on s at different resolution can be easily transformed into a hierarchy of 


Decision making processes of planning-control procedures In the most general form, the 
controller can be rep t t sea l e d as a boa with three inputs, and only one output. Three inputs can be 
specified as follows (see Figure 6*): 

-Task: the goal (Q to be achieved, (and conditions to be satisfied including the parametrical 
constraints, the form of the cost function, its value, or its behavior). 

-Description of the “exosystem", or map of the world including numerous items of 
information to be taken in account during the process of control; map of the world (M) is often 

^^^^brmatioo (I) is the^oniiation set delivered by the sensors in thevery beginning of 
the process of coorrol, and continuing to be delivered during the process of ACS operation. 

The processes within the controller are iTlustrated in Figure 6J>AdJnput j has determined where the 
points SPj and G are situated within the input map M. Input I gives a limited zone Oj^-O^Cin the 





vi c init y of SP^) in which the information set is more reliable, or even exhanstive.Thus, in the overall 
planned tr aj ectory SPj-G'j-Gp a part SPj-G^ can be d eter mined with more reliability than the rest of it. 
In other words, the overall trqectory SPj-G’j-C% from SP to G might be changed in the future if the 
input I will update the map M in the way that the computed (planned) tr aj ectory will become not the 
most desirable alternative. However, SPj-G j part of the plan (bold line) won't be changed: no new 

infbnnatioo is expected. 

Let ns concentrate now on the part of the trajectory SPj-G'j which is assamed to be more known than 
the test of the overall planXabel the point Gj the "new goal", or the "goal for the lower level of the 
nested hierarchy". Notice that instead of the planned curve segment SP-G’j the stripe is known with 
boundaries B +1 . Within this stripe, a new planned motion trajectory can be determined at a higher 
level of resolution pertained to the level (i+1). Again, only part of the trajectory SP-CTi+1 can be 
refined within the sector Oi^i-Oy+i- TO* m tum * us to the more precise part SPj +1 <Tj+i 
which can be subsequently refined at the level (i+2). En e nt ua Dy "new goals" of the adjacent levels are 
becom ing indistinguishable and the the trajectory SP-Gn can be utilized for computing the actual 
control sequence All previously determined trajectories are ptons at different level of refinement 

This consideration includes the following components of the joint planning/control process . 

i F indin g the optimum plan SP-G based upon the map M, am the task formulation (SP, G, 
cost-function, constraints). 

1.1 Computing the alternatives of SP-G. 

\2 Comparison of die available alternatives. 

1 3 Selection of the preferable alternative. 

? U pd ating the map information M in the vicinity of SP by using the sensor information L 

2.1 Recognition of the set L 

22 Comparison between M and L 

2.3 Deciding upon required changes in the cases of: M/I#0, I/M *0, I*M. 

2.4 Creation of the new map in the vicinity of SP with req uir ed deletions and additions. 

3 .Refined planning the path within the updated zone of the map. 

3.1 Determining the subgoal G* (e.g. as a point of intersection of SP-G and the 
boundaries of updated put of the map). 

3.2 Finding the optinum plan SP-G* ( which implies that the whole set of procedures 
mentioned in p.l, should be repeated). 

4. Track the optimum path SP-G*. 

5. Upon arrival to the new point of the selected trajectory (distinguishable from the initial 

point) loop to the position 2. 

The set of procedures 1 recursive through 3 is illustrated in Figure 6»b. Easy to notice, two major 
recursions are presumed within the structureof accepted decision making activities. Firstly, position 
3 2 generates recursion which presumes consecutive refinement of the information within the zone 
which allows for this refinement Secondly, the major loop from 5 to the position 2 presumes 
repetition of the whole set of the procedures after each i ncrem ent of the motion. Thus, the process of 
pooh pUnning can be substituted by a con se c ut ive determin ing of subgoals located closer and closer to 
the current positiooHowever, still remains unclear a) how to d etermin e the trajectory SP*C, and b) 
how to determine the zone in which the refined information should be obtained. These two key 
elements of the overall process will dete rm i n e the number of recursions to be performed for the each 
point of the motion trajectory. 

Substitution of positioning by tracking Theory of tracking control is much better developed 
than the theory of positioning (or control of "pick-and-place" operations). No wonder, we are 
int er e s ted in reduction of positioning problem to the tracking problem. The similarity between our 
control and "tracking the target", is becoming even more noticeable after we realize that the tracking 
trajectory is being constantly rec ompute d in the process of the above mentioned recursion. 

Obviously, our best planned trajectory can be considered as a predicted trajectory. At the each level of 
the system shown in Figure 6, the bold part of the trajectory is a plan per sc, and the rest is just a 
predicted trajectory. However, for the next consecutive lower level the situation is becoming different 
The plan of the upper level is becoming just a planning envelope for the lower level. Within the 
planning envelope assigned by the upper level, an optimum motion trajectory is being refined 
which in turn is considered as a plan for the adjacent level below. The initial part of this trajectory is 
considered me low resolution control to follow (1-st part of the plan) and the rest is becoming 
just a prediction (2-nd part of the plan). 

Since part of SP-G is cosidered as a prediction anyway, and since the co rre sp onding information is to 
be updated in the future, the problem of system’s readiness to incorporate the results of updating 
information, can be discussed. This generates such topics as storing the alternatives of plan, evaluation 
of predictions by some probability measure, and synthesis of contingency plans. 

Commutative diagram for a nested hierarchical controller. Hierarchical decision making 
process allows for using efficiently the full computer capacity which is limited at each level of such 
hi erarc hy (with no branching). In this case, the tree hierarchy of intelligent control coovens into a 
nested h ier a r ch ical controller (NHO. If NHC is acting under the above mentioned constraints 
the process of control allows for decoupling in parts dealing separately with information of different 
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degree of resolution (easily interpreted as certainty, belief, etc.) This means that the degree of 
"fuzzirress" is different at different levels of the hierarchy, and m the nested hierarchy of the 
fuzzy-state automata each automaton of the lower level (automaton-child) h enc l os e d hi 
the corresponding parent-automaton. and serves for clarification of its uncertainties. 

Cons id e ring subsystems as categories C, and the interaction among them as functors F, the 
commutative diagram of the ACS can be shown in Figure 7 (indices mean: s-scasing, p-perceptioa, 
k-knowledge, pc-pianmng/control, a- actuation, w-wori d). Feedbacks are not shown: boxes are 
conn e ct ed by "factors" which cl a r act c rizc the itructaic conservation in a set of mappings of interest 
The bold boriatmtal line sepmes two major different parts of the system: what is below, is a worid of 
real objects, and what is above die bold line, is the world of information processing. All of the 
•'boxes" in figure 7 are fuzzy-state automata. They are easily and adequately described in terms of fe 
automata theory, and provide consistency of the descriptions, c o m pu ter representations, and control 
operation. Then, the search can be done by combining A* and dynamic programming, discretization of 
tb? space is being determined by the level of resolution, and the rules which are formulated within the 



given context. 


nprt LOt*ti 


Nested dynamic programming The principle of optimality of Bellman [22] can be stared as 
follows for stochastic problems: at any time whatever die present information and past decisions, the 
remaining decisions must constitute an optimal policy with regard to the cur r ent information set 
[23].Thesequence of "pUmring-navigating-piktag (or guidance)-actuator control (or execution)" 
appears as a direct result of nested hierarchical search in the structure of information mder 
consideration. Method of Nested Dynamic Programming (NDP) follows from the commutative 
diagrams and analysis given in [6-9]. It stales that the optimum control should be found by 
consecutive top-down and bodom-up procedures, based on the following rules. 


Rule I. NDP should be p e rfo rmed first at the most generalized level of information system 
with complete (available) worid representation. 


Rule 2. NDP is being performed consec uti vely level after level lop down. The subspace of the 
search at each of the consecutive lower levels is constrained by the solution at the preceding apper 
level rec ompu ted to the resolution of the next lower level 

Rule 3. When during the actual motion, due to the new information, the optimum tra j ectory 
determined at a given level must violate the assigned boundaries, this new information should be 
submitted to the upper level (proper generalization must be performed, and the information strecture 
must be updated). This gener a tes a new top-down NDP process. 

Rule 4. When arrival of the new informal m is bounded (e.g. by a "limit of vision"), then the 
re cur s i on of nested process of planning is being done with consecutive process of subgoals crea tion. 

Control Stratified by Resolution into a Joint Multilelel Planning/ Control I recess. 
The nested hierarchy of maps {mj},i« 1,2^.. is the input for plasning/control system. Actually, this 

nested hierarchy is being generated in the process of interaction between the subsystems M and C . 
Let us show how this process of i nt eraction is going 
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| fa fa fa | fa | 

i ... ... I l 

Iine2:NDP( m l ... ... NOPa^M^)-!^ NDP^.M^- m* 

l ... ~ l i 

line 3: output ... CH( CH( 

l i l 

to controller ... to 0-2Hfc to (i-l)*th 

levels 

Line 1 shows two nested hierarchies: one of them by generalization (of maps {Mj}> and another by 

focus of attention (of maps {nt|}). Hierarchy of sets is obtained from the hierarchy of sets by 
applying NDP-algorithm per level (line 2). In order to do this, a bested hierarchy is added to the 
nested hierarchy . In order to compute a set 4 he results of applying NDP per level, arc enhanced op to 
the meaningful consistent map partition; one of possible algorithms for this is "convex hull" (CH). So 
this system is closed loop level to level top-down and after convergence, the system of controller 
commands is obtained. 

This planning/control algorithm represents actually a hierarchy of blackboards (HUB) in which 
the communication is being rendered among interacting subsystems of the intelligent module.Main 
navigator takes this plan as a suggestion of the milestones, and determines a string of subgoals at the 
way to the first of milestones. This string is sent to the pilot which also has nested stnicturc.The fust 
sub goal in this string might be invisible for the ACS, the visible goal is to be determined by the 
planner within the pilot. Then pilot's navigator can compute accurate enough trajectory of 
motion to be executed. This trajectory is submitted to controller which in turn, has nested 
structure. Its planner determines the next tarcking command, then its navigator determines the 
execution sequence, etc. 

Built-in combinatorial opera tors: team of decision-makers Not only strings or 
combinations of variables (words) as well as combinations of mappings (clauses) will be considered, 
but also combinations of these combinations. Search by scanning, and inclusion when the desirable 
property is met, is one of the straightforward algorithms of combination generation. If the results of 
search are constantly enhancing the input vocabulary, then during the exhaustive search with recursive 
enhancement of the vocabularies, all possible unions, intersections, and complementations of the sets 

are being obtained. The final vocabulary forms a field (F) which means that it contains all set of 
subsets constructed upon the initial set including the results of applying all acceptable combinatorial 
operations, (one of these operations should be later used for decision making process: combinatorial 
search). Using focus of attention we receive a special category of limited fields which do not 
contain all combination of components which is required by a formal definition of field, and yet gives 
more meaningful recommendations without introduction of complicated algebraic structures. 

Using search for alternatives generation. Any combinatorial algorithm is an operator of 
generating plans or solution alternatives for a decision-making process. Consider A* -algorithm 
for the search of minimum path trajectory [29,32.35], or any type of conventional or ’enhanced" 
dynamic programming 1223331,33]. Then a number (value) is assigned to each of the combinations 
generated (preferability, closeness, propensity, cost-effectiveness, etc.) which will enable the 
decision-maker to make his choice under the accepted strategy of decision making. According to 
the existing terminology, the chain of consecutive decisions named policy of decision-making, or 
policy of control 

Since we have received already a hierarchical structure of representation, and N levels are considered 
which are representing the same world with different resolution, the following situation should be 

considered. Given a vocabulary consisting of N elements at the level T (words) wj j, 

wjsjj the set Sj of admissible decisions (or decision N-tupIes ) determined within the boundaries 
determined by the upper level B{ Wj.j } 

S i -W| i ®W2i®**® w Ni m ^ w iK 

2 nd assume the cost-functionals (e.g. presented as distances) 

J i :{w i },B{w i . 1 }-*p i 

then the obtained N-tuple (a string W|W^ w n ) is the i- level hierarchical solution. This string can be 
interpreted as the next subsequent state of the world, or the change leading to the next subsequent state 
of the world (action). In the latter case, the subactions at various levels of the hierarchy, show the 
overall action which leads from one substate to another. Clearly, any decision making process is a 
result of decision making activities of a couple of adjacent levels, which means that the 
planning/control procedure in a result of a recursive computation upon the whole hierarchy of 
representation. Strictly speaking, the decision making at a level require involvement of at least two 
adjacent levels. Thus, the structure of the levels representation is becoming of importance. 
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It is shown in [5-9] that the phenome na of nesting by g en e raliz ation and focusing the attention can be 
characterized best by the operation of inclusion which presumes some procedures unusual for the 
conventional approaches to control systems. Indeed, nesting by generalization is obtained as a result of 
a)grouping the object of the i-th level by the class-generating fea t ure , b)assigning a label to this group, 
c)plaring this laber into the (i-l)-th level as a single object, d)repeating the same for the words of the 
6-lHh level ^nd e)fmally, obtaining a new word at the (i-2>th levcLThen, any class of the (i-l)-th 
level is nested by genermthatioa in its much broader representation at the i-th leveiOn the other 
- hand, after a solution is obtained as a string within the class of the (i-l)-th level, this solution will 
automatically "carve out" a subset within the corresponding much brooder representation at the i-th 
level, of the same (i-l)-th level class in which the solution was de te n nin cdThc result of such "carving 
out" is nested by attention within its own class of the i-th leveL 

Partitioning and nesting of r e p resen tations. Decomposition of the categories of representation 
is done through decomposition of objects and morphism* represented in this category [24]. 
Decomposition imlies dividing objects and relationships in parts, so the components of objects are 
becoming of interest which was not the fact before the process of decomposition. This, in turn, 
implies higher resolution of world representation than before the process of decomposition. If we 
continue with dec o mpo s ition, the further representations are expected to disclose new details about the 
objects and their parts, as well as about relations and their parts. So, in the hierarchy of 
de com po s itions, all of the levels describe the same world with higher and higher level of resolution. 

Changes in time are represented by se q uences of the snapshots in domain of representation 

describing sequences of the world states. Thus, change in the time-scale is intrinsically linked with the 
value of resolution. Certainly, different levels of the hierarchy can be characterized by different 
time-scales. AUthese phenomena are illustrated in Figure & 

Nested Tesselatioa of Knowledge. This system of nested variables and nested mappings is 
described in a Hausdorff nested H^spnce which means that any two different n-dimensicnal points in 
it have at each level of nesting, disjoint neighborhoods. One may assume that our space is obtained as 
a result of natural, and or artificial discretization (tesselatioa, partitioning) from an initial continuous 
space of the isomorphical world description. This space can be considered as a nested stale-space for a 
dynamical system in which the trajectory of morion can be represented This space is considered fora 
given moment of time (snapshot of the world). Then, a s e q uence of snapshots can be obtained The 
conventional state-space is a s up erpo sit ion of all snapshots which describe the process. 

Two types of discretization (natural, and artificial) should be understood as follows. After the problem 
is formulated, it is already based upon some world discretization since the context is represented by a 
semantic network discretizing the world in a "natural" way. However, when the higher level of 
resolution is desired, the natural discretes can appear to be insufficient Then another "artificial" type 
of discretization is applied, and the space is tessdated by (say) a “mechanical", quantitative division of 
larger bodies into the smaller parts. 
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Hus tesselation is dooe in such a manner that the "points of interest" (symbolizing the variables, 
words, or wwfs) are placed to the center of the "tile" of tcss eli tio n at a level (elementary segment, 
grain, discrete, pud, or voxel of the space). Such terms as segm e ntatio n, granularity, discretization, 
and tesselation can be used m ter mi n ent ly. Property of being centere d, bolds if the tile can be derived 
as a system of subsets with unempty intersection. This property should be considered rather in a 
symbolic way: in fret, we cannot discern any another point within the die, this is a m i nim u m grain at 
this level of resolution. 

Resolution of Knowledge In other words, the die of the tes sel atio n determines the resolution 
of knowledge which is defined as a mmimum discrete of information, or minimum wwf which can 

be stated unmistakably. The mimmum centered die will have diameter e and the net of centos emerging 

from this tesselation is named £~net [25lAnalytical details can be found in [6-9). 

The idea of nested tesseladons is coming together with a definition of a single die T( e ) based upon 
nested sphere theorem which can be rephrased as nested die theorem which defines a chain of 

inclusioosfor the hierarchy of mclatiom Thus, e -net is considered to be a set of elementary dies 
satisfying a condition •*» 

T(*0* e 0 ) 3 T(xj, e i > 3 t < x 2* e 2 ) 3 ~ 3 T < x n, c n > 


where xj, xj,--, x„ are the coordinates of the centers of the dies, 

C 1 , £ 2 . — * E n are the radii of the nested dies. 

In the equation of relationships among the dies £| £2 £ Q 

— — ■••• — 
a l °2 

Fairs of adjacent levels. Hierarchies created in this way, satisfy the following principle: at a 
given leveC the results of generalization (daises) serve as primitives for the above 
levet. Then each level of the hierarchy has its own classes and primitives; thus, it has its own 
variables (vocabulary), and the algorithms assigned upon this vocabulary can be adjusted to the 
properties of the objects represented by the vocabulary. This determines the mandatory role of 
combined consideration of two (at least) adjacent levels of the hierarchy. Set of relationships among 
the variables at the i-th level describes the implications which are being utilized for decision* making at 
this particular level. 

On the other hand, the set of relationships at the (i+lMh level describes the relationships among 
classes and thus can be characterized as set of metaimpliculmis (metarules, metaclauses) which are 
governing the process of applying the implications (roles) at the i-th level In the light of this 
consideration, each two adjacent levels can be understood as a complete E. Post production system 
(analog to "general problem solver'* or "knowledge based controller") m which the metarules applied 
to the alphabet of the lower level act as a semi-Thue process of the grammar (261. 

"natural" (qualitative) way (based upon "words" of the context), and the lower level is discretized in an 
"artificial" (quantitative) way (based upon grids, etc.). The process of decision making in this case 
depend on the ability of these two levels to communicate efficiently despite of the different 
representation of the elementary "tiles". The role of human "master" or "supervisor" is critical for 
ope rati on of such adjacent levels since be is the real carrier of the contest knowledge which is required 
for the adequate translation from the language of the (i-l)-th level into the language of i-th level and 
vice versa. 


Reuohttiou of repr esen ta t io n , labeling the class presumes dealing with this class as a primitive 
at the given level of consideration. Moreover, this class (now, also a primitive) is being again clustered 
in classes of the higher level In order to deal with class as with a primitive we have to neglect the 
inner c on te nt of this dass (which might be reflected as new p rop er ti es of the new primitive but with no 
mentioning the initial primitives with their properties). The levels of the hierarchy of representation 
(since they are created by a mechanism of generalization) are dealing with the tame world given with 
different level of richn es s in submitting specific details, level of coarseness (fineness). We will name 
this characteristics of world representation at the level resolution which is a measure of 
distinguishability of the vectors in the sate space. 

Accuracy versus resolution. It is clear that after assigning to the cluster a new class-label (a word 
to be included to the vocabulary), this class-labd is becoming a new primitive with its own prop ert ies, 
the numerical values are assigned to these new prop er tie s , and these numerica l values are chareterued 
by the accuracy depending on the accepted evaluation theory for this particular property (including 
probabilistic approaches, fuzzy set theory, etc.). Clearly, this accuracy evaluation is formally 
independent from the act of neglecting the inner contents of the new primitive. This means that 
accuracy and resolution are formally independent The word "formally" means: in the view of 
procedure to be perfonned.(Consider digitized images (e.g. any "map" of the world) with different 
base discrete of the image. The bigger this discrete is, the less is the resolution of image. However, the 
accuracy of representation at this level can be the same p rovided the accepted value of error upon the 
base discrete). 
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Thus, accuracy presumes the error evaluation in term* of the existence of difference between the world 
and in description within Utt accepted concept of the node L The smaller the vocabulary £. 
is. the more different phenome n a air negl e ct e d . This neglect may entail the increase in error and may 
not However, the smaller Card(£.), or size of the vocabulary is, the higher is the level of 

generalization, and the larger is the radius of the tile in the €-oet Thus, the following relation should 
hold 1 


p > £ 


Card(£.) 

where p determine* (he value of aOowtbfc error (uaccimcy) and Card(£.) determines the value of 
resolution. 

Thus, the information of the world which is required for decision-making, should be explicated and 
prepared for the subsequent decision-malting processes. Map is defined as a subset of the state-space 
which is to be taken in consideration during the process of decisioo- making. Thus, map is a part of 
policy delivered from the leader k> the follower. Map of the upper level contains the maximum subset 
given at the lowest resolution. Maps for the next levels of the nested map structure (top down) are 
obtained using the second apparatus of nesting; focusing of attention. Thus, only one part of the map 
is being activated; which is required for the current decision- nuking. 

The system of maps has dual nesting: 

firstly, we have a subsystem with nesting by generalization 

see a 

Mj o M 2 d ... o Mj_| z> Mj 

which we name "CARTOGRAPHER", and assign to this subsystem main******* of die information 
rather than active participation in the process of decision-making. 

and secondly, we have nesting by focusing attention superimposed upon the nested hierarchy by 
generalization , and this information extracted from the cart ogr ap her (m^a-l^Z-. is delivered to the 
"C system ( Figure 7 ) in a form of "maps for decision making". 


h | f« I I b k b 

(m x € M ,P(m 2 € M 2 ) mj.jc (nte M,) 

£* fa fa fa 


All fa-predicates are performed on the basis of NDP-algorithm results and thus belong to the 
subsystem of control, all g-predicates are prerogative of the system of map maintenance. Later we will 
show how these predica tes are built in the algorithms of planning/control and map maintenance. 

The problem of map maintenance is of scientific and practical importance. The upper level map 
f planner s map") should be maintained for a long time due to the largest scope, and the "slow 
rhythm" of this level. Changes in the upper level map are not frequent Maps of the subsequent levels 
are to be regularly updated with increasing frequency but decreasing volume. At the level of "pilot s’* 
map, most of the information might be considered of little importance in long terms, and the map t& an 
"ephemeral" one. The lowest level map ("controller’s map'*) may or may not need even an ephemeral 
map maintained as a part of the nested hierarchy. (Actually, fhxn our first experience of dealing with 
ACS we found that intelligent module cannot afford maintenance of the pilot map , Le. of the lowest 
level of world representation), and therefore all processes related to the real time operation have 
ephemeral structure indeed, with a number of logical filters determining whether this ephemeral 
information contains anything k> be included in the maps of the upper level 

The rules of assigning for the information to be retained in details, retained in generalization, or 
droppe d , cannot be formulated consistently for all possible situations. How tong the information will 
be needed can probably be d e t ermin ed only by a master. 

Generalization: belonging to a meaningful class. So. knowledge in a context can be 

represented as an £ -net at a definite resolution, and as a system of nested £ -nets with different scale 
where scale is defined as a ratio betwe en resolution at a level and resolution at the lowest level 
dearly, each of the larger tiles at the upper level is a "generalization" for the set of smaller tiles at 
the lower level of the hierarchy. Selection of one of the tiles at the upper level (focusing anenoon ) 
entails selection of a definite subset of smaller tiles at the lower leveL 
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We would like to urtu die fact that the mctasioo XdXdx show* in thit hierarchy of the tile 
e mbed din p has mote i m port an t and broadmeaning than just 'scaling of the sixe*. The inclusion 

predicate j has a meanit^ of “belonging to a class* (since it is s ss nmrdih s t the objects are unified into 

a set by some class generating property, or featare). One can talk about state space, space of weighed 
prooerties, and so on, and the notion of “belonging to a class of come spatial neighborhood" is 
becoming closer to a meaning of "generalization" as if it is understood in the discipline of logic. Then 
dicretizacion of the state space roil contribute simultaneously to a) minimum required interval of 
consideration, b) hierarchy of dames of belonging to a meaaigM neighborhood. 

From the theory of pattern analysis and image recognition we know that selection of the meaningful 
neighborhood is a difficult issue, and it c an not be addressed exhaustively unless a human operator, or 
master is involved in the procedure of the feature assignment. 

Look-up Tables. The prespecified lists of mappings upon a vocabulary, can be organized in 
look-up tables (LUTs) for convenience. For example, a control “u" can be selected from this 
prespecified set if LUT contains clauses (e.g. “If S *C then o' where S-is a slate description. 
C-strategy selected, or cost-functional agreed upon). Minimum look-up table can contain only one 
mapping. 


Sets of variables to be considered simultaneously are named vectors, or s tr in g s . A single LUT, or 
a set of LUTs axe named grammar (operators, transformations) if they can be utilized to 
generate output strings from input strings. Input and output vocabularies tog et h er with the grammar 
are named language (over a finate alphabet), or a utom a t on (free monoid gener at ed by the alphabet ). 
Clearly, vectors or strings are rt a t e men ts in die above mentioned language (built upon words of this 
language). The rules of combining variables into vectors, or rings, or strings or vectors, etc. are 
being det ermin ed by LUTs . 


Special role of attention When a part X .is detached from the "whole" X (which may happen 
to be category, object, and/or morphism) and the relation of inclusion holds 


x=x p 

this separation of Xp from X we will name focusing attention upon Xp . Sampling is one 

of the common methods of focusing atteation.Usually we focus the attention when the subset of 
attention can be considered important, or is typical for the whole scl The latter case links focusing 
attention with mechanism of generalization. 

Special role of attention is determined by its close links with the overall goal of operation. Attention 
always presume sacrifice of some information in favor of the information set which is considered to be 
more important Thus, attention almost always rely on a set of pref ere n ces that can be ultimately 
formulated only by a master. 

Generalization oriented tend at ion We would like to stress the link between the generation of 
entries for LUT as an approximation in the space of consideration, and the problem of 
generalization oriented tesselation (discretization of the space). At the level of discretization 
determined by the context, i.e. determined by the words of the semantic network, tte results of 
tesselation are always determined by the vocabulary of the muter. 

The subsequent problems of "digitization” aid "quantization", or quantitative tesselation at the lower 
level are being solved currently by introduction of the "shah function”, and ocher mechanisms of 
sampling which has been proven to be applicable in decades of development of communication and 
control systems. Some difficulties, such as aliasing, and similar, lead to algorithmic aggravations at 
the output In the context of this paper, discretization of the space does not allow for the problem of 
aliasing because there is no information between the adjacent tiles of tesselation (digitization, 
quantization), and the information about the tile properties (values for them) is the set of average 
average values over the tile. Clearly, the term "avenge” in this context, acquires a somewhat unusual 
meaning of “ class generating property” .However, in most of cases the”automatic” tesselation of 
the space creates discrepancies when the corre s pondence betwe e n the two adjacent levels is to be 
determined. These discrep an cies might be eliminated by the interference of the master. 

Complexity of tesselation: C-entropy .Complexity of LUT is being evaluated by computing the 

€ -entropy (by A.N. Kolmogorov [251 ) for a space where the corresponding e-net has been 
constructed 


H^-logN^S) 

where S-is a space represented by LUT, with e-net assigned. 

Ng-nutnbcr of elements (nodes) in e-net. or tiles in the tessclatioa 

For the system with combinatorial search as a tool for planning, the category of consideration can be 
repre sen ted as a power set, then ‘nvialiy 
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HgfSJ-NrfS) 

Variou theori es of planning are b as ed apon the idea of sp a ce tesselarioo (tj, confi gurarin space, 
esc.). A multphctiy of diflGc^eot toaepet of space tesadatioa is ccesacd, and numerous techniques of 
evaluating the thstaace, sad the c o m p fcxity are known from de literature. It isemential lo undentand 

that all of these techniques aacend lo the theory and fo rmalisms of 6-octs. In oar case, tninimiz a ri oa of 

the e-entropy allows for detti mining an o p tim a ip n a mber of the levels of the hierarchy of a control 
system. 

Acoaracy of rtpiwftohra. To all words and ail edges with the co rr es pon di ng strength of the 
bond, the values of a cc uracy are assigned Accuracy is understood as the value of the relative error 
of the quantitative cha ract erist ics assigned to the node or the edge of the graph. This evaluation can be 
baaed on estimation of probabilities, z o nes of un ce r tainty, anchor in any another way. The approach to 
the world representation in this paper does not depend oa the particular way of dealing with 
uncertain ty evalnatkmThe value of uncertainty is assigned tote numerical I values associated with the 
properties of the tile of representation which is con sidered as a uunimum unit at a level. 

Evalaartou of the tee of a te This is similar so assigning a definite e-oet H ow e ver , this also 
suggests that the nunimam value of the radius of the tile, cu be time d e pe n de n t In order to avoid this 
predicament in the following treatment , are will try not to get involved with the particular stochastic 

and dynamical micr o s tra c tate of the C-tile at the level of the ^pres entation hierarchy. We will define 
the radius of the tile by the width of the fictitious uniform distribution which has the same value of the 

conditional entropy as the real distribution of the variable x. Then, using the value of conditional 
entropy 

H- - J pj(x) la pj(x) dx 


for a Gaussian the diameter of a tile is determined 

A- o (*e/2) 5 

Referring to the definition of C-net, we would suggest that this value of A is the minimum siae of the 
tile radius to he assigned if the net has the same law of dtsaibuboc in all of its nodes. For systems 
with stationary random processes, evaluation will be sufficient with no invo l v emen t in analysis of 
stochastic processes anymore. Certainly, this depend on the nature of what is considered to be s 
random c o mp on en t of the variable. 

Nevertheless m real situations, it is very difficult to co n s tr u ct a level with the same law of di s tribution 
in all of its nodes. The vole of master here, is either to d eter m ine the "average" law of distribution, or 

to allow for a net with different sizes of tiles. Based upon condition for A, the problem of different 
laws of state-space tessclation known from the theory of morion planning (e.g. potyhedra, etc.) is 
virtually diminaaed. The g eom et ry of a single tile become s irrele v ant , and yet the space is fully covered 
by these "fuzzy" tiles. 

IIL Hybrid Master-Dependent Representation 

Knowledge Bases: Semantic Networks with context oriented interpretation 
Knowledge Bases (KB) are considered to be a collection of well-formed formulas (wffs) for 
man-machine as well as for autonomous decision-support sy s t e m s of different kinds. So, it is clear 
that knowledge consists of linguistics discretes (entities) which are later referre d to as units of 
knowledge. When we are talking about knowledge, the represented knowledge is actually 
meant, (Le. we are not interested here in discussing the name of the reality represented within the 
system of world representation). Nesting is being introduced often in a semantic way , and reflects 
semantic discretization of resolution in representation reflecting human experience (which sometimes is 
irrelevamlThtts. in a nested system, a nested hierarchy of semantic networks can be formulated. This 
semantic nesting can be int er pret e d within a context only under human supervision since the subtleties 
of the context knowledge must be properly transformed into statements of existence or absence of 
relationships among the entities. 

Thus, under masters supervision we receive, two types of aested hierarchies for declarative wfTs: 
existential nesting (nested statement of existence) including nested statements of objects and relations 
among them, and transitive nesting (nested statement of change). Both of these nested units of 
knowledge are presented in implicative form (nested clauses). It seems reasonable to describe the 
set- theoretical on one hand, and on the ocher hand, vector-analytical m anners of describing situations 
(which do not differ in essence). This another form of representation in turn, can be divided m two 
different kinds of representation: continuous (using differential equations) and discrete (using 
difference equations and/or finite state machines (see figure 9). In both cases, the property of nesting 
is applied. 

If a hierarchy is built using the existing semantic network, them each (i- 1 Hh level of the hierarchy will 
contain generalizations of the words of the i-th level This means that the solutions found within the 
(*-l)-th level will automatically "carve out" subsets withia the classes of i-th levels in which the 
process of c om b in atorial search can be repeated, and a new solution can be found with higher level of 
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However, the i-th level should 


the (i-I)-th nmiy on the bo undari e s of the 


Postulate of wlHpli represen tation . So. the same world can be represented within the same 
levels of resolution in a different way. Representation is defined ■ a s tru c t ure (e.g. algebraic, or 
infor mation st r ucture ) which is h o m o mo rphic to the world, to the structure of reality (or a domain of 
reality). Representation con ti s tt of both numerical as we* as descriptive informati on about the objects 
and systems, and is luine d to be ob t ai ne d hunt prior experien ce, and or derived t h eor eti cally (based 
up on multiplicity of existing and potrible toote of logical reference). 

The p h e no menon of multiple world rep t wj u ari on presumes that b o mont o r phisms exist between 
various rtpic re ntarions.Cuncntly , various bodies and t echniq u es of world representation are used in 
the p racti ce of control, based upon di fferent el e men t s and rules of information org an i z a tio n In this 
paper, knowledge bases as a technique of world representation, are being focused upon. Knowledge 
Bares as a model of information system, is a system of world repr esentati on which is considered to be 
homomorphic to other systems of world rep r esenta tion such as systems of difference, or 
differential, or integral equations, and others (see Figure 9). 

Nondetermi nistic nested refe r enci ng. Accuracy and reso lut ion can mistakenly be understood as 
noodeterministie p rop erti es of re pr esen tation. We win repar aie the ch a racte ris tics of accuracy and 
r e s olu t ion from the nutidc tcnnmistic information Let the vector of observations be 


Xo-Xod + S 


where deterministic model after re co g niti on. 

£ -stochastic co m ponent after observation. 

Definition. A component of observation it named s to cha sti c component if it is 

a) not identified (yet) with any of models stored in the knowledge base, 

b) substantially larger than meas u r e of ac cu racy and resolution ( I $ >p), 

c) presumed to potentially affect the results of decisaommakng. 

Our approach differs from the classical only in a sense of (1 1) which implies two recommendations. 

Rectmrntwiarioml. Control problem is to be solved as a deterministic problems dealing with models 
Xpd and estimating likelihood or plausibility of the decision, or the policy by measure of uncertainty 

Imbed with the set of {^}- 

Recommendatiom 2.. Learning will be understood as a tool for extracting new recognizable models 
from { ^ } rather than for updating knowledge of probabilisti c c har acteristics of the set { ^ } . 

The following structure of dealing with unrecognized (unaodelled) information is implied by these 
two recommendations. Initial decomposition should be be repeated recursively for the nested structure 







of information. At each level the component is being de co mposed in two parts: which can be 
lecofn^edandiiidiaMiathedetennuasticpaitof the next level, and which at the next level remains 

still u nre c ogniz able (with E[ ^ 1-0) 

x 0i- x odi + $r.i+I + *i 


where deterministic model after recognition at the level i, 

of the stochastic com p on en t * thei-th level which will be 

recognized after observation at the (i+l)-th leveLCtrend"). 

-part of tbe s t och a stic co m po n en t at the i-th level which remains unr eco g niz e d . 


This recursive analysis of the stochastkhrfbnnatkm can be iUostraied as follows 

Xoi« x odi + ^rj+l + x 0,n-l“ x od,n-l ♦ ^r,n + *»n-l 


^j+l” x o<U+l + tr,i+2 + ^i+1 ^.n" x od,n + 


and n is the level where the rec u rsion slops (no consequtive levels are expected to be built). 

This deco mp osition of information (which is possible within the nested hierarchical structure) allows 
for multiple re fer e nce system. Tbe key motivation for the multiple referencing is simplification of 
information representation per leveL Multiple ref eren cing is indirectly presen ted in the requirement that 

E[ ^ ]*0. This means that the origin is placed in a point is the state space as to provide E[ 5j ]*0. 

Then, the rest of the information allocated for decision-making at this level is re f ere nced to these 
origin. 

Another important implication of mnltlpfc* referencing in dealing with nondeterministic 
information, is related to the topic of learning. As mentioned above, the system is supposed to deal 
with partially, or comp let el y unknown world. Thus, Searakg is presumed Any learned information is 
being identified with memory models (patterns) which determine the initial referencing. The residual 
information is supposed to be collected, and later it is expected to gen er at e a new pattern upon the 
multiplicity of realizations. If generation of a new pattern seems to be impossible (no regularities are 
discovered), the change in die initial referencing might be undertaken. This philosophy of dealing with 
new information is to be utilized for procedures of map apdating 

We can sec also within the body of this problem of nested referencing, a direct link among the 
quantitative characteristics of the system and its linguistics! description, and the components of this 
description. At tins time, however, we will restrain from further statements w* these inks since we do 
not have enough factual observations. 

Recognition and Identi ficati on. All of tbe above statements are based upon Definition containing 
undefined word “identified", hi further considerations, the word "recognition’* is u s ed Some hit of 
patterns is presumed winch should be used for compari son and identification. Recognition is also 
loosely defined but some freedom seems to be allowed for possible enhancement of the list of existing 
patterns. Most of these mailers deserve a special and detailed treatment, they are not discussed m this 
paper. However our a ttitu d e toward this domain should be at least illustrated by an 

An example of interpreting the situation with identification, recognition, and learning the new preterm 
of the entities of the world, is shown in Figure 10. If A is a robot location, and B is the goal, then 
min i m u m time path can be sought in one of the following areas: 1, U, and QL It can be demonstrated 
geometrically, that the minimum distance path can be found in the area EL Howeve r, since each turn 
within this "slalom-type” area is linked with the losses of time (speed at the turning point should be 
reduced to avoid s k i dd ing ), then the m i n i mum time trajectory seems to be within one of the areas I or 


It seems, that even before we start to compute all and possible trajectories within these areas, they can 
be analyzed as some entities with common properties. Indeed, area I can be described as an area 
which has “obstacle 1“ on the right of the moving robot all over the motion, area Hi has "obstacle 2" 
on the left of the moving robot, and area 0 has obstacles on both sides. Areas I and IB do not seem to 
be different when robot is moving far from the obstacle, but they differ substantially if we try to make 
the length of the trajectory as small as possible: the trajectory in the are I will have 5 linear segments 
and four turns while the trajectory III wtO have only two linear segm e nts and only rere turn. 
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Farther analysis shows that the cost-functions have different form for all three areas. Moreover, 
within one particular area cost-function can be co nsi dere d moootooo c in the sense of [32). These kind 
of areas are named "topowaya* (33), and they can be considered entities for minimum time problem 
solving at the higher level of plannmg/control system. Rales can be formulated in which the 
co ndition part wffl describe the relative obstacle location while the co ns eq u e nt part will be related 
lo the most general description of the topoway recommended for farther consideration. 

Cleariy, rules of this level of generality have id be recognized by a master, however they can be 
utilized with no master's direct p arti cipa tio n . 

On the eqai valence between the difference equation model, and the production rules. 
Difference equations can be easily transformed into produ cti o n roles. Indeed, instead of the form 

xflt+1)- A<k) x<k) + B(k) o(k) 

where k-is the number of the stage of r ec ursi o n , 

A(k) and B(k) are the matrices of system parameters,' 
x-isa state, 
u-is a control. 

Instead of having this information in a form of an equation one can state 

IF {x(k) A A(k) A B(k) A ii(k)} -> THEN {x(k+l» 

which actually describes the causality exposed by a particular system : "if present state is given, and 
the parameters are known, and some definite control n applied, then the state will change as follows". 
In most of the real systems causalities obtained exper&aentally and/or from the other models of 
representation can be inverted in a form of rukt-prescriptions [28] 

IF{x(k) A x(k+l) A A(k) A B(k)} -> THEN (u(k)} 

which can be in terpr e ted as follows: " if present state is given, and the the following state is required, 
while the paiu nct en of the system are known, then apply this controT. 

In some cases even the form of trajectory can be utilized for rules form u l ation. Indeed, the form 

k-1 

x(k) = F(k,0) *(0) + ^F(k, 1+1) BO) u(l). and 
1=0 

F(k+lJ+l) = A(k) F(k, 1+1) 


implies the following ways of subse q uent planning/control activities: 

1) solution trajectory oo-line computation, submitting to the execution controller, and storing 
in memory for the subsequent use in a similar situation, 

2) retrieving the previously stored solution for the same or similar conditions, obtained from 
off-line training, or horn on-line experi ence. 

Applying the production rules at different resolution levels. The above consideration can 
be expanded if the prior behavior is taken in consideration in order to estimate how the reality differs 
from what was expected and provide correctives for the control signal, or "tuning* for the matrices A 
and B (using available techniques of extrapolation). 

Thus, the following sets of infonnation can be considered initially known: 

S -states : (x(0), x(-l), x(-2),~.} 

P -parameter, : {A(0), B(0), A(-l), B(-l), _} 

G-goal states : (x(k), x(k-l 

The general form of a control-generating rule can be represented as follows 

IF [P A S A G]* -> THEN DO U 

where U -is a string {u(l)» u(2),*~, u(k-l), U(k)}» 

•-means that the is Pareto- optimal 

Solution can be found by one of the selected search procedures. There is a set of optimum solutions, 
the cost difference between them can be found only at higher lesolutionNDP is done a the following 
sequence of procedures: 

SUB S T ITU T E THE "OUT-OF-REACH" GOAL BY AN ACHIEVABLE GOAL 
FIND A CONTROL-GENERATING RULE 

IF THE CONTROL-GENERATING RULE IS NOT FOUND, APPLY SEARCH 
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SUBMIT THE SOLUTION TO THE NEXT LOWER LEVEL 
IF THE SOLUTION IS NOT FOUND, REPORT THE PREDICAMENT TO 
THE NEXT 

UPPER LEVEL 


Thi* approach is very general *nd produces the trajectories of morion in iD ca t e*: when the general 
ink exist and is known to the plxmnn (/control system, or when it does exist but is unknown. All 
a) tori duns of path-search in 2D binary world start with a statement IF THERE IS NO 
OBSTACLE BETWEEN THE ROBOT AND THE GOAL, GO DIRECTLY TO THE 
GOAL, ELSE DO THE SEARCH [29 J. In fact, this ink mast be proven by g eom etrical methods 
(Le. at the higher level) or foang by a search after disexetixation and petting the problem to the lower 
kveLlhis is the way of Gating the trivial trajectories A and B in Figaro 1 Ladner the trajectories A 

and B me obtained as a resah of the search procedare. the co ne sp onding strings of commands can be 

stored far sa b seqae nt using them as solutions in correspondi ng mkt [371. 


In the case shown m Figure lljbwc have a less trivial situation. Indeed, the lower kvd search can 
lead as in a straightforward manner to the trajectory A. H ow e ver, when the back-up motion is 
allowed, at least one additional trajectory should be added: a backing ap morion B and then motion 
forward C This new opport un ity immensely reduces the productivity of search. One would probably 
prefer to first select one of these opportunities (A or B+C) at the higher level, and then compute the 
actual trajectory. 



* • • * ngare 12. Taiwan rw tf »w* t« f an rrh AppMntlaa 

te m Nawad Mtra re k ra l C tkwB tf 


Firm 1L Faa mpt ra af —We typical i 


IF ROBOT IS BECOMING CLOSE TO AN OBSTACLE (DISTANCE IS LESS 
THAN D) 

(ON THE RIGHT, OR ON THE LEFT) 

THEN PUT MESSAGES TO PILOT AND EXECUTION CONTROLLER TO 1 
PRIORITY 
AND 

IF DISTANCE IS LESS THAN D* AND MORE THAN D** 

THEN REDUCE SPEED TO V* AND MAKE A TURN 

(LEFT, RIGHT) 

AND 

IF DISTANCE IS LESS THAN D** 

THEN STOP AND REPLAN 


One can see that these roles do not refer to any specific global coordinates of the trajectory to be 
executed, and the local coordinates (position of the obstacle relative to the robot) are given with low 
accuracy using linguistic variables as it was done in [23]. Similar roles are formulated for a more 
subde maneuver when after the local goal was determined in a particular situation, it turned out to be in 
an inconvenient location. e.g. the actual location of G~ Figure 6) cannot be achieved in a 
near- minimum time fashion by a simple continu at ion of the motion ahead. 

IF G(X) IS LESS THAN R T MIN 

AND G(Y) IS LESS THEN 2 R T M7N 
AND ORIENTATION IS LESS THEN |90“1 


THEN BACK-UP AND TURN IN THE DIRECTION OPPOSITE TO THE GOAL 
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( G(X) and G(Y) are the V and "y" coordinates of the local f oal in a local reference frame, ie. 
when the coordinate system is attached to the robot, R T min is the minimum radius of turn). 


Tis rule allows to perform a nontrivial motion shown m Figure 1 l,c which reproduces a very 
anth ropomorp h ic way of dealing with this probtenuNo wonder - it was introduced by a human 
"masrer^.We do not have any experience in formulating rules like this aotomarically.lt seems that 
using the human experience and intuition in formulating rules would be beneficial for dealing with 
predicaments arising during processes of operation. 

The overall process of using the rules previously formulated and stores, and the search when the rule 
is not found in the list, is illustrated in Figure 12. 

Learning of nrics.Thus, if the rule is not on the list, the recommendation is obtained using the 
search in the state space, or in other words, by solving the automaton of representation, or by solving 
difference equations of representation via (say) enhanced dynamic programming [31, 33, 36]. The 
results of this search can be stored and later used as a rule. Then the number of rules will grow 
tremendously, and instead of spending rime for search the system will spend rime for browsing the 
lists of rules. Probably, there exist an optimum number of rules depending on the descriptive 
properties of the space as well as the characteristics of the computer system utilized in a specific 
intelligent robot 

On the other hand, if a group of rules can be generalized and pushed to the upper level of the 
hierarchy, then the overall time of search can be reduced. Va% generalization can be done as follows 

DETERMINE FEATURES OF CONDITION PARTS OF RULES IN STORAGE 
FIND SIMILARITIES AMONG THE FEATURES OF RULES IN STORAGE 
GROUP THE CONDITION PART OF RULES IN STORAGE 
GROUP THE CONSEQUENT PARTS OF RULES WITHIN THE GROUP OF 
RULES 

WITH SIMILAR CONDITION PARTS 

SUBSTITUTE ALL CONSEQUENT PART BY ONE (AVERAGE) SOLUTION 
TO THE CORRESPONDING LIST OF RULES 

The process of learning with new rules generation is illustrated in Figure 13. The stage of 
"generalization" can be performed so far only with "master* direct participation. Indeed, the control 
strings found as a response to the concrete situations should be stored but the subsequent analysis 
should be done by a “master* unless the reliable algorithms of generalization are develops! 


ntw* 13. S*w lain i 



I 


Task from (i-l)-lh lev*! 


TO THE 
EXECUTION 
CONTROLLER 




In the meantime, the other types of learning (primarily, inductive leanring) can be cxcerciscd with no 
human involvement. They include memo riz ing the snapshots of the world, analysing the evolution of 
the snapshots, and computation of correct i ves for the matrices A and B as well as for the string of U. 

Retrieval of ruIes.The first experience of operation of autonomous mobile robot Drexel 
Dune-Buggy has demonstrated that us in the lists of rules is inefficient, and the hierarchical structure 
increases the productivity of the rules retrieval. The structure is shown in Figure 14. It is based upon 
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the theory presented in [38]. L^ is the language of conditions conutting of their vocabulary and the 
weighted relationship* among them. Ly h the language of consequents also consisting of the 
vocabulary and the gr ammar of weighted relationship* among the words of this vocabulary. The 
matching algorithm is based upon the grammar translator co nsistin g of the weighted relationships 
among the words of L* and Ly. Tme matching process C ends with obtaining several "best" 

machings, then evaluation, selection, and decomposition of the proper rule is done ({EJS£>}). 

After de c omposition is completed, focusing of attention should pe performed (FA), after this the 
search of the proper rule of the next level can be performed. The process is not fully automated since 
the process of focusing attention not always can be done with no master involvement. 

IV. Coodushms 

In existing systems the function of "master* is working in the DIM-aiea. This presumes that master's 
participation is expected to be required at the stages of 

context selection, 

arranging the blackboards for the specific context, 
assignment of the search envelope, 
supervised learning. 

To be more specific his functions will include (but not limited to) the following activities: 

1. Making available the "universe of discourse" knowledge. 

2. Proper selection of the context subset 

3. Monitoring the processes of image recognition especially while sensor integration. 

4. Final judgment on the space discretization (uniform, nommiform,etc) based upon master's 
opinion on what is "meaningful neighborhood". 

5. Monitoring the process of cost-function assignment 

6. Monitoring the process of vocabulary determining for the adjacent levels. 

7. Elimination of discrepancies in world representation at the adjacent levels. 

8. Monitoring the assignment of the relations of nesting by generalization. 

9. Determining the scope of attention according to the general assignment of the operation. 

10. Final decision on the duration of retaining the stored information especially for the levels of 
ephemeral maps. 

1 1 . Detenmnimg the rules of the high level of generality 

12. Arbitration among the multiple alternatives. 

13. Direct dealing with the problem of the lower level if the upper level vocabulary is poor. 

14. Participation in the processes of new rule recognition. 

15. Doing the job of linguistical tesselction: determining the groups of entities belonging to the 

same level of discretization. 

Expectantly, the language for communication with the "master" will be different from the language to 
be utilized for dealing with the other robots of the cooperative t eam 
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